Recording reproduction apparatus, recording reproduction method, and program

ABSTRACT

A recording reproduction apparatus includes: a captured data acquisition unit configured to acquire first captured data captured by a first camera that captures an image of an outside of a moving body and second captured data captured by a second camera that captures an image in a direction opposed to a display surface of a display unit; an event detection unit configured to detect an event on the moving body; a recording controller configured to store, when an event has been detected, the first captured data as event recording data; a face detection unit configured to detect a human face from the second captured data; a reproduction controller configured to reproduce the event recording data when a human face has been detected within a period after storage of the event recording data; and a display controller configured to cause the display unit to display the reproduced event recording data.

CROSS REFERENCE TO RELATED APPLICATION

This application is a Bypass Continuation of PCT/JP2019/018576 filed onMay 9, 2019, which is based upon and claims the benefit of priority fromJapanese patent application No. 2018-108741, filed on Jun. 6, 2018, thedisclosure of which is incorporated herein in its entirety by reference.

BACKGROUND

The present disclosure relates to a recording reproduction apparatus, arecording reproduction method, and a program, and more particularly, toa recording reproduction apparatus, a recording reproduction method, anda program for appropriately reproducing data in which an accidentoccurring with regard to a moving body such as an automobile that hasbeen detected is recorded.

Dashboard cameras that detect an impact on a vehicle and store videoimages for a predetermined period of time before and after the timingwhen the impact has been detected as event recording data in such a waythat this data is not overwritten have become widespread. For example,Japanese Unexamined Patent Application Publication No. 2009-087007discloses a dashboard camera that records video data based on transitionof acceleration.

SUMMARY

In many dashboard cameras including the aforementioned dashboard cameradisclosed in Japanese Unexamined Patent Application Publication No.2009-087007, in order to reproduce event recording data stored when anevent occurring due to an accident or the like is detected for thepurpose of checking the circumstances of the accident, it is required tooperate the dashboard camera, select the event recording data, which isthe target to be reproduced, and perform an operation of reproducing thecorresponding data. Alternatively, it is required to remove a memorycard or the like that stores event recording data recorded by thedashboard camera and to reproduce the corresponding data in anotherapparatus.

It is possible, however, the event recording data may not beappropriately reproduced when the circumstances of the accident arechecked such as in a case in which the user of the dashboard camera doesnot know the functions of the dashboard camera very well.

This embodiment has been made in view of the aforementioned problem andaims to provide a recording reproduction apparatus, a recordingreproduction method, and a program capable of easily checking eventrecording data.

A recording reproduction apparatus according to this embodimentincludes: a captured data acquisition unit configured to acquire firstcaptured data captured by a first camera that captures an image of anoutside of a moving body and second captured data captured by a secondcamera that captures an image in a direction that is opposed to adisplay surface of a display unit; an event detection unit configured todetect an event on the moving body; a recording controller configured tostore, when the event detection unit has detected an event, the firstcaptured data including at least data at a timing when the event hasoccurred as event recording data; a face detection unit configured todetect a human face from the second captured data; a reproductioncontroller configured to reproduce the event recording data when theface detection unit has detected a human face within a predeterminedperiod after the storage of the event recording data; and a displaycontroller configured to cause the display unit to display the eventrecording data reproduced by the reproduction controller.

A recording method according to this embodiment includes: a firstcaptured data acquisition step for acquiring first captured datacaptured by a first camera that captures an image of an outside of amoving body; an event detection step for detecting an event on themoving body; a recording step for storing, when an event has beendetected, the first captured data including at least data at a timingwhen the event has occurred as event recording data; a second captureddata acquisition step for acquiring second captured data captured by asecond camera that captures an image in a direction that is opposed to adisplay surface of a display unit; a face detection step for detecting ahuman face from the second captured data; a reproduction step forreproducing the event recording data when the human face has beendetected within a predetermined period after the storage of the eventrecording data in the recording step; and a display step for causing thedisplay unit to display the event recording data reproduced in thereproduction step.

A program according to this embodiment causes a computer operating as arecording reproduction apparatus to execute the following steps: a firstcaptured data acquisition step for acquiring first captured datacaptured by a first camera that captures an image of an outside of amoving body; an event detection step for detecting an event on themoving body; a recording step for storing, when an event has beendetected, the first captured data including at least data at a timingwhen the event has occurred as event recording data; a second captureddata acquisition step for acquiring second captured data captured by asecond camera that captures an image in a direction that is opposed to adisplay surface of a display unit; a face detection step for detecting ahuman face from the second captured data; a reproduction step forreproducing the event recording data when the human face has beendetected within a predetermined period after the storage of the eventrecording data in the recording step; and a display step for causing thedisplay unit to display the event recording data reproduced in thereproduction step.

According to this embodiment, it is possible to easily check eventrecording data.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a block diagram showing a configuration of a recordingreproduction apparatus according to a first embodiment of the presentdisclosure;

FIG. 2 is a diagram showing the exterior of the recording reproductionapparatus according to the first embodiment of the present disclosure;

FIG. 3 is a diagram showing the exterior of the recording reproductionapparatus according to the first embodiment of the present disclosure;

FIG. 4 is a diagram conceptually showing a relation between captureddata and event recording data according to the first embodiment of thepresent disclosure;

FIG. 5 is a flowchart showing a process example of the recordingreproduction apparatus according to the first embodiment of the presentdisclosure;

FIG. 6 is a flowchart showing a process example of a recordingreproduction apparatus according to a second embodiment of the presentdisclosure;

FIG. 7 is a flowchart showing a process example of a recordingreproduction apparatus according to a third embodiment of the presentdisclosure;

FIG. 8 is a diagram conceptually showing a configuration of a recordingreproduction apparatus according to a fourth embodiment of the presentdisclosure;

FIG. 9 is a block diagram showing a configuration of a vehicle-sideapparatus that forms the recording reproduction apparatus according tothe fourth embodiment of the present disclosure; and

FIG. 10 is a block diagram showing a configuration of a mobile terminalthat forms the recording reproduction apparatus according to the fourthembodiment of the present disclosure.

DETAILED DESCRIPTION

In the following description, with reference to the drawings,embodiments of the present disclosure will be explained. While thedescriptions will be given taking an example of a dashboard camera usedin an automobile, which is a moving body, as an example of a recordingreproduction apparatus according to the embodiments in the followingdescription, the present disclosure is not limited thereto. The presentdisclosure can be applied also to, for example, various types of movingbodies such as vehicles like motorcycles or automobiles, railroads,ships, robots, and persons. Further, the present disclosure is notlimited by the following embodiments.

Hereinafter, with reference to FIGS. 1 to 5, a first embodiment of thepresent disclosure will be explained. FIG. 1 is a block diagram showinga configuration of a recording reproduction apparatus 10 according tothe first embodiment of the present disclosure. The recordingreproduction apparatus 10 is mounted above a windshield of a vehicle asa dashboard camera in such a way that it is directed toward a front sideof the vehicle, detects an impact that corresponds to an accident, andstores captured data during a period including the timing when anaccident has occurred as event recording data. The recordingreproduction apparatus 10 which serves as the dashboard camera is notlimited to the one mounted on a vehicle as a single apparatus and may beapplicable also to a configuration in which it is provided as a functionof a navigation device or a configuration in which it is mounted on avehicle in advance.

In FIG. 1, the recording reproduction apparatus 10 includes a controller100, which is a recording control device, a first camera 210, a secondcamera 220, a recording unit 240, an operation unit 250, a display unit260, a sensor 270, a Global Positioning System (GPS) receiver 280.

While the recording reproduction apparatus 10 is mounted on the vehiclein such a way that the capturing direction of the first camera 210 thatcaptures an outside of the vehicle is directed to the front side of thevehicle, it may be mounted on the vehicle in such a way that thecapturing direction of the first camera 210 is directed to the back sideor the lateral side of the vehicle. Further, the recording reproductionapparatus 10 may be an integrated apparatus or may be provided in aplurality of apparatuses in a dispersed manner.

FIG. 2 is a diagram showing the exterior of the recording reproductionapparatus 10 according to the first embodiment of the presentdisclosure, and is a front view when the recording reproductionapparatus 10 is seen from the direction in which an outside of thevehicle is captured. That is, FIG. 2 shows a view when the recordingreproduction apparatus 10 is seen from the direction in which the firstcamera 210 captures images.

FIG. 3 is a diagram showing the exterior of the recording reproductionapparatus 10 according to the first embodiment of the presentdisclosure, and is a back view when the recording reproduction apparatus10 is seen from the direction opposite to the direction in FIG. 2. Thatis, the second camera 220 and a display surface 261 of the display unit260 shown in FIG. 3 are arranged on the same plane.

When the recording reproduction apparatus 10 is mounted above thewindshield of the vehicle in such a way that it is directed to the frontside of the vehicle so as to capture images on the front side of thevehicle, the first camera 210 in FIG. 2 can capture images on the frontside, which is an outside of the vehicle, via the windshield of thevehicle, and the second camera 220 and the display surface 261 of thedisplay unit 260 are directed toward the cabin of the vehicle, in otherwords, toward the driver.

With reference once again to FIG. 1, the controller 100 is formed of oneor a plurality of Central Processing Units (CPUs), Graphics ProcessingUnits (GPUs), buffer memories 121 etc. that perform various types ofdata processing, and executes various kinds of processing by programs.The controller 100 at least includes, as its components and functions, abus line 110, a captured data acquisition unit 120, a captured dataprocessing unit 122, a recording controller 123, a reproductioncontroller 124, an operation controller 125, a display controller 126,an event detection unit 127, a movement information acquisition unit128, and a face detection unit 129. In the following description, thecomponents of the controller 100 are described to be the ones thatexchange data such as captured data via the bus line 110.

The controller 100, which is a recording control device that executesoperations according to the present disclosure in the recordingreproduction apparatus 10, executes a recording method according to thepresent disclosure. Further, the controller 100 is a computer thatoperates a program according to the present disclosure.

The first camera 210 captures images of an outside of the vehicle, whichis a moving body. The first camera 210 may be integrated with therecording reproduction apparatus 10 or may be connected thereto as aseparate component by a wire or wirelessly. Further, a unit includingthe first camera 210 and the captured data acquisition unit 120 may beconnected thereto as a separate component by a wire or wirelessly. Thefirst camera 210 includes a lens, an image-pickup element, an Analog toDigital (A-D) conversion element and the like, although they are notshown in the drawings. The first camera 210 outputs first captured datathat has been captured to the captured data acquisition unit 120.

While only one first camera 210 is provided in FIG. 1, the first camera210 may be formed of a plurality of cameras. The first camera 210 maybe, for example, a plurality of cameras of a desired combination ofcameras that capture respective images of the front side, the back side,the lateral side, and inside the cabin of the vehicle.

The second camera 220 captures images in the direction that is opposedto the display surface 261 of the display unit 260. The display unit 260may be replaced by a display panel that forms the display unit 260. Thesecond camera 220 may be integrated with the recording reproductionapparatus 10 or may be connected thereto as a separate component by awire or wirelessly. Further, a unit that includes the second camera 220and the captured data acquisition unit 120 may be connected thereto as aseparate component by a wire or wirelessly. The second camera 220includes a lens, an image-pickup element, an Analog to Digital (A-D)conversion element, although they are not shown in the drawings. Thesecond camera 220 outputs second captured data that has been captured tothe captured data acquisition unit 120.

While only one second camera 220 is shown in FIG. 1, the second camera220 may be formed of a plurality of cameras. Further, the second camera220 may be a camera that captures a visible light, a camera thatcaptures an infrared region, or a combination thereof.

While the first camera 210 and the second camera 220 are described ascameras different from each other in FIG. 1, they may be a single cameraas long as ranges to be captured by the aforementioned first camera 210and second camera 220 can be captured by a single camera. The singlecamera is, for example, an all-around camera of 360 degrees.

The captured data captured by the first camera 210 and the second camera220 is video data. The captured data may include, besides video data,audio data. In this case, the first camera 210 and the second camera 220each include a microphone.

The recording unit 240, which is a non-volatile memory for recording thefirst captured data captured by the first camera 210 by the controlperformed by the recording controller 123, is, for example, a memorycard. The first captured data recorded in the recording unit 240 isreproduced by control of the reproduction controller 124. The recordingunit 240 may be replaced by a separate recording reproduction apparatusincluding the recording controller 123 and the reproduction controller124 in addition to the recording unit 240. The recording unit 240 may beintegrated with the recording reproduction apparatus 10 or may beconnected thereto as a separate component by a wire or wirelessly.

The operation unit 250, which is an interface that accepts an operationon the recording reproduction apparatus 10, outputs information on theaccepted operation to the operation controller 125. The operation unit250, which is various kinds of buttons or a touch panel, accepts anoperation by the user. The operation unit 250 may accept an operation byanother apparatus connected thereto wirelessly. The operation unit 250accepts, for example, a user's operation of starting recording of anevent. Further, the operation unit 250 accepts a user's operation ofperforming reproduction of the event recording data.

The display unit 260 is a display device that displays various kinds ofinformation by the control performed by the display controller 126. Thedisplay unit 260 includes a display panel such as a liquid crystal panelor an organic EL panel. The display unit 260 may be integrated with therecording reproduction apparatus 10 or may be connected thereto as aseparate component by a wire or wirelessly. The display unit 260 may beanother device that is connected wirelessly and includes the displaycontroller 126.

The sensor 270, which is, for example, an acceleration sensor, detectsacceleration applied to the recording reproduction apparatus 10 or thevehicle. The sensor 270, which is, for example, a three-axisacceleration sensor, detects acceleration applied in the front-backdirection of the vehicle as the x-axis direction, right-left directionof the vehicle as the y-axis direction, and the vertical direction ofthe vehicle as the z-axis direction. The sensor 270 outputs theinformation on the detected acceleration to the event detection unit127. The sensor 270 may be integrated with the recording reproductionapparatus 10 or may be connected thereto as a separate component by awire or wirelessly. Further, the sensor 270 may be a separate componentas a unit that includes the sensor 270 and the event detection unit 127.

The GPS receiver 280 is a GPS antenna that receives signals from a GPSsatellite. The GPS receiver 280 outputs the received signals to themovement information acquisition unit 128. The GPS receiver 280 may beintegrated with the recording reproduction apparatus 10 or may beconnected thereto as a separate component by a wire or wirelessly.Further, the GPS receiver 280 may be a separate component as anotherapparatus including the GPS receiver 280 and the movement informationacquisition unit 128.

The captured data acquisition unit 120 acquires the first captured datacaptured by the first camera 210 and the second captured data capturedby the second camera 220. The captured data acquisition unit 120 outputsthe first captured data acquired from the first camera 210 to the buffermemory 121. The captured data acquisition unit 120 outputs the secondcaptured data acquired from the second camera 220 to the face detectionunit 129.

The captured data acquisition unit 120 acquires, from the eventdetection unit 127, a signal indicating that an event has been detected.When the event has been detected, the captured data acquisition unit 120may acquire the second captured data from the second camera 220. In thiscase, the captured data acquisition unit 120 may cause the second camera220 to start its operation when the event has been detected.

The buffer memory 121, which is an internal memory included in thecontroller 100, temporarily stores captured data for a certain period oftime acquired by the captured data acquisition unit 120 while updatingthis captured data.

The captured data processing unit 122 converts captured data that thebuffer memory 121 temporarily stores into, for example, a desired fileformat such as MP4 format, which is encoded by a codec having a desiredsystem such as H.264 or MPEG-4 (Moving Picture Experts Group). Thecaptured data processing unit 122 generates captured data generated as afile for a certain period of time from the captured data that the buffermemory 121 temporarily stores. As a specific example, the captured dataprocessing unit 122 generates 60-second captured data generated as afile in the order of recording from the captured data that the buffermemory 121 temporarily stores. The captured data processing unit 122outputs the generated captured data to the recording controller 123.Further, the captured data processing unit 122 outputs the generatedcaptured data to the display controller 126. While the period of thecaptured data generated as a file is set to be 60 seconds as oneexample, this is merely one example.

The recording controller 123 performs control to cause the recordingunit 240 to record the captured data filed by the captured dataprocessing unit 122. In the period during which the event detection unit127 does not detect an event, the recording controller 123 records thecaptured data filed by the captured data processing unit 122 in therecording unit 240 as the captured data that can be overwritten. Whenthe recording capacity of the recording unit 240 has reached the upperlimit, the recording controller 123 overwrites the captured data thatcan be overwritten recorded in the recording unit 240 with new overwritedata from a recording area where old captured data is recorded. Thecaptured data recorded by the recording controller 123 in the recordingunit 240 is the first captured data captured by the first camera 210.

Upon receiving information indicating that the event detection unit 127has determined that an event has occurred, the recording controller 123stores the first captured data in a predetermined period including theevent occurrence timing as event recording data that is prohibited frombeing overwritten.

A desired method may be used as the method of storing the eventrecording data by the recording controller 123. For example, awrite-protected flag is added to a header or a payload of a section inwhich overwriting is prohibited in the first captured data, and theevent recording data is stored in the recording unit 240. Alternatively,the section in which overwriting is prohibited in the first captureddata is stored in the overwriting prohibited area of the recording unit240. Alternatively, the section in which overwriting is prohibited inthe first captured data is transmitted to another apparatus, where theevent recording data is stored.

The reproduction controller 124 performs control for reproducing thecaptured data recorded in the recording unit 240. The reproductioncontroller 124 reproduces, besides the captured data that has beenrecorded in the recording unit 240 and can be overwritten, the eventrecording data where overwriting is prohibited, and outputs thereproduced data to the display controller 126.

The reproduction controller 124 starts, based on the results of thedetection by the face detection unit 129, reproduction of the eventrecording data that has been stored most recently. Further, thereproduction controller 124 reproduces various types of captured databased on the reproduction instruction accepted by the operation unit250.

The operation controller 125 acquires operation information that theoperation unit 250 has accepted and outputs the operation instructionbased on the operation information to each of the components. When theoperation controller 125 has acquired an instruction for selectingvarious types of data, which are to be reproduced, from the operationunit 250, the operation controller 125 causes the reproductioncontroller 124 to select the file and the like recorded in the recordingunit 240. When the operation controller 125 has acquired an instructionregarding reproduction of various types of data from the operation unit250, the operation controller 125 causes the reproduction controller 124to perform processing regarding reproduction. The instruction regardingreproduction of various types of data includes, for example,reproduction start, pause, reproduction stop, enlarged display, etc.

The display controller 126 performs control for causing the display unit260 to display various types of information. The display controller 126causes the display unit 260 to display, for example, first video datawhich is being captured by the first camera 210. Further, the displaycontroller 126 causes the display unit 260 to display the eventrecording data stored in the recording unit 240 reproduced by thereproduction controller 124. Further, when the display unit 260 includesa touch panel function as the operation unit 250, the display controller126 causes the display unit 260 to display an icon or the like forperforming a touch operation.

The event detection unit 127 acquires the acceleration informationdetected by the sensor 270, which is an acceleration sensor, anddetermines that an event has been detected when acceleration thatcorresponds to an event has been detected. When the event detection unit127 has determined that the event has been detected, the event detectionunit 127 outputs information indicating that an event has been detectedto the recording controller 123.

The event detection unit 127 determines whether the acceleration outputfrom the sensor 270 corresponds to acceleration when a vehicle hascollided with another object such as another vehicle and detects thatthe acceleration output from the sensor 270 as acceleration thatcorresponds to an event when it corresponds to the acceleration when thevehicle has collided with the other object such as the other vehicle.The acceleration that corresponds to an event may be weighted in each ofthe x-axis direction, the y-axis direction, and the z-axis direction.Further, acceleration that sharply rises may be detected as theacceleration that corresponds to the event.

The movement information acquisition unit 128 specifies, based onsignals from a GPS satellite that the GPS receiver 280 has received, thecurrent position for each time, and outputs the current positionalinformation for each time to the recording controller 123. The movementinformation acquisition unit 128 specifies the latitude and thelongitude as the current positional information. The movementinformation acquisition unit 128 may receive, besides signals from theGPS receiver 280, radio waves such as Wi-Fi (registered trademark), andspecify the current position using positional information of an accesspoint as well.

The face detection unit 129 detects a human face from the secondcaptured data captured by the second camera 220 and acquired by thecaptured data acquisition unit 120. The face detection unit 129 uses adesired method such as pattern matching.

The face detection unit 129 determines whether the human face detectedfrom the second captured data has come close to the display surface 261of the display unit 260. In other words, the face detection unit 129determines whether the human face detected from the second captured datahas come close to the display surface 261 that composes the display unit260. The face detection unit 129 determines, based on the distance ofthe human face or the compositions that compose the human face in thesecond captured data, whether the human face has come close to thedisplay surface 261 of the display unit 260. When this determination ismade, the distance between the second camera 220 and the human face isdirectly detected. However, as shown in FIG. 3, the display surface 261of the display unit 260 and the second camera 220 are arranged on thesame plane or on substantially the same plane in the housing of therecording reproduction apparatus 10. Therefore, the face detection unit129 determines the distance between the second camera 220 and the humanface to be the distance between the display surface 261 of the displayunit 260 and the human face. Further, while an error occurs depending onthe detected human face, it is sufficient that it can be determined thatthe person detected from the second captured data has come close to thedisplay surface 261 of the display unit 260 in order to gaze at thedisplay surface 261 of the display unit 260.

Further, the face detection unit 129 detects the opening degree of theeye in the human face detected from the second captured data. In otherwords, the face detection unit 129 determines, from the human facedetected from the second captured data, whether this person is simplypresent in this position or this person is gazing at the display surface261 of the display unit 260 based on the opening degree of the eye. Theface detection unit 129 detects the opening degree of the eye from thegap between the upper and lower eyelids.

Further, the face detection unit 129 detects the line-of-sight in thehuman face detected from the second captured data. In other words, theface detection unit 129 recognizes the eye part from the human facedetected from the second captured data, and determines, from apositional relation or the like of the iris in the recognized eye,whether the line-of-sight of the person detected from the secondcaptured data is directed toward the display surface 261 of the displayunit 260. Further, when the second camera 220 is a camera that capturesan infrared region, the face detection unit 129 detects theline-of-sight based on reflection of a pupil or a cornea.

Further, the face detection unit 129 may determine whether the humanface detected from the second captured data is a human face registeredin advance. The person registered in advance, which is, for example, adriver, a passenger or the like of the vehicle, may be registered inadvance before the vehicle travels or may be automatically registeredwhile the vehicle is travelling. In other words, the face detection unit129 determines whether the person registered in advance is gazing at thedisplay surface 261 of the display unit 260. The face detection unit 129may determine that the human face registered in advance has beendetected when a plurality of faces have been concurrently detected fromthe second captured data and at least one of the plurality of faces thathave been detected is a human face registered in advance.

Referring next to FIG. 4, the relation between the first captured dataand the event recording data will be explained. FIG. 4 is a diagramconceptually showing a relation between the captured data and the eventdata. The horizontal axis of FIG. 4 indicates the passage of time, andindicates that the time passes toward the right direction.

The symbol SH1 in FIG. 4 indicates the first captured data acquired fromthe first camera 210 by the captured data acquisition unit 120 andtemporarily stored in the buffer memory 121. The dotted lines of SH1 inFIG. 4 correspond to time t−3 to time t+2 described in the time axis,and each indicate the period for the captured data processing unit 122to generate a file. Since a file has not yet been generated in the statein which the first captured data is temporarily stored in the buffermemory 121, the time is shown by the dotted lines.

The symbol SH2 in FIG. 4 indicates the first captured data obtained byfiling, by the captured data processing unit 122, the first captureddata temporarily stored in the buffer memory 121, and recorded, by therecording controller 123, in the recording unit 240. For example, thecaptured data D-3, which is data captured between time t−3 and time t−2,is filed and recorded in the recording unit 240 in a state in which itcan be overwritten. Further, the captured data D-2, which is also datacaptured between time t−2 and time t−1, is filed and recorded in therecording unit 240 in a state in which it can be overwritten.

When, for example, the recording capacity of recording unit 240 hasreached the upper limit, in the first captured data shown in SH2 in FIG.4, the captured data before the captured data D-3 is overwritten, thecaptured data D-3 is overwritten next, and then the captured data D-2 isoverwritten.

When, for example, an event has been detected at time T1, which isbetween time t−1 and time t, the first captured data in the period froma predetermined period of time before time T1, which is the eventoccurrence time, to a predetermined period of time after time T1 isstored as the event recording data. The predetermined period of time is,for example, but is not limited to, a period from 30 seconds before timeT1, which is the event occurrence time, to 30 seconds after time T1.

As one example, when an event has been detected at time T1, which isbetween time t−1 and time t, the recording controller 123 stores thecaptured data D-1 in the overwriting prohibited area of the recordingunit 240 as event recording data D-1″.

When, for example, the recording capacity of the recording unit 240 hasreached the upper limit, in the first captured data shown in SH2 in FIG.4, the captured data D-1 is overwritten after the captured data D-2 isoverwritten. However, the captured data D-1 is definitely stored sinceit is stored in the overwriting prohibited area of the recording unit240 shown in SH3 in FIG. 4 as event recording data D-1′.

The first captured data in the period from time t−1 to time t is filed,and the event recording data D-1″ stored in the overwriting prohibitedarea of the recording unit 240 is event recording data including timeT1, which is time when the event has occurred. The event recording datais not limited to the first captured data in a period generated as afile including the event occurrence timing. The event recording data maystore, for example, the captured data in the period from a predeterminedperiod of time before time T1, which is the event occurrence time, to apredetermined period of time after time T1 as the event recording data.The predetermined period of time is, for example, but is not limited to,30 seconds.

Further, the storage of the event recording data is not limited tostorage in the overwriting prohibited area of the recording unit 240.For example, the event recording data may be recorded in a recordingunit included in another apparatus registered in advance using acommunication function (not shown). As a specific example, the eventrecording data may be transmitted to a smartphone owned by a driver or apassenger that has been paired with the recording reproduction apparatus10 in advance and has established communication with the recordingreproduction apparatus 10. Alternatively, the event recording data maybe transmitted to an apparatus such as a server owned by a driver, aperson who has a relation with the driver, an insurance company, or asafety assurance company registered in the recording reproductionapparatus 10 in advance.

Each of the first captured data and the event recording data ispreferably recorded in association with the positional information thatthe movement information acquisition unit 128 has acquired.

Referring next to FIG. 5, a flow of recording reproduction processingexecuted by the recording reproduction apparatus 10 will be explained.The recording reproduction processing executed by the recordingreproduction apparatus 10 is executed by the controller 100, which is acomputer operating as a recording reproduction apparatus, based on aprogram. The functions of the controller 100 may be executed by controlapparatuses included in a plurality of apparatuses or a plurality ofunits in a dispersed manner. In this case, the program can also beexecuted in a cooperative manner for each apparatus or each unit.

The start of the processing in FIG. 5 means, for example, that theengine, the power supply or the like of the vehicle, which is the movingbody, is turned on and the recording reproduction apparatus 10 can beoperated. The processing may be started when the operation unit 250accepts an instruction to start recording reproduction processing.

Along with the start of the processing, the recording reproductionapparatus 10 starts recording the captured data and detecting an event.The start of the recording of the captured data includes start ofacquisition of the first captured data from the first camera 210 by thecaptured data acquisition unit 120, filing of the first captured data bythe captured data processing unit 122, and recording of the firstcaptured data in the recording unit 240 by the recording controller 123.In this case, the first captured data is recorded in the recording unit240 in a state in which it can be overwritten, and this recording isalso referred to as normal recording or loop recording. Further, thestart of the detection of the event means that the event detection unit127 starts to acquire acceleration information from the sensor 270 andthe detection of the event is started based on the acquired accelerationinformation.

Further, while each of the processes shown in FIG. 5 is being executed,the recording of the first captured data, the detection of the event byacquisition of the acceleration information, and the specification ofthe current positional information by the movement informationacquisition unit 128 are continuously executed.

In Step S101, the event detection unit 127 determines whether an eventhas been detected. The event detection unit 127 determines that theevent has been detected when the acceleration detected by the sensor 270is, for example, acceleration that corresponds to a collision of anobject with the vehicle. The acceleration that corresponds to acollision of an object with the vehicle may include a case in which theabsolute value of the acceleration is equal to or larger than apredetermined threshold or a case in which the absolute value of theacceleration is equal to or larger than a predetermined threshold andthe rising of this acceleration is sharp in a predetermined manner.

When it is determined in Step S101 that the event has been detected(Step S101: Yes), the recording controller 123 stores the first captureddata including the data at the event occurrence timing detected in StepS101 as the event recording data (Step S102). The recording controller123 stores the first captured data including the data at the eventoccurrence timing in the overwriting prohibited area of the recordingunit 240 as shown in, for example, FIG. 4.

When it is determined in Step S101 that the event has not been detected(Step S101: No), the process moves to Step S107.

When the event recording data has been stored in Step S102, therecording controller 123 determines whether a first period has passedafter the storage of the event recording data in Step S102 (Step S103).The processing of Step S103 may be determination regarding whether thefirst period has passed after the detection of the event. The firstperiod is preferably a period including a period during which, after anevent such as an accident occurs, a person involved in this accident ora person related to this accident tries to reproduce and check the eventrecording data that corresponds to this event. In other words, whenthere is no reproduction request until the first period passes after thestorage of the event recording data, it can be said that the eventrecording data is the one that is not required to be reproduced andchecked since this event is not due to an accident. The first period is,for example, ten minutes.

When the recording controller 123 has determined, in Step S103, that thefirst period has not passed (Step S103: No), the face detection unit 129determines whether the human face has been detected from the secondcaptured data captured by the second camera 220 (Step S104). In otherwords, for the first period since the event recording data is stored oran event has occurred, the face detection unit 129 detects a human facefrom the second captured data captured by the second camera 220.

When the second camera 220 is used in the aforementioned application,the second camera 220 and the face detection unit 129 may not beconstantly operated. When, for example, the event detection unit 127 hasdetected an event, the second camera 220 may start capturing images andthe face detection unit 129 may start detecting the face.

When the face detection unit 129 has not detected a human face in StepS104 (Step S104: No), the process moves to Step S103, where it isdetermined whether the first period has passed. When the recordingcontroller 123 has determined, in Step S103, that the first period haspassed (Step S103: Yes), i.e., when it is determined that a human facehas not been detected during the first period, the process moves to StepS107.

When the face detection unit 129 has detected a human face within thefirst period in Step S104 (Step S104: Yes), the reproduction controller124 reproduces the event recording data stored in Step S102 based on theevent detected in Step S101 (Step S105). In other words, when the humanface has been detected within the first period (Step S104: Yes), theevent recording data generated due to the occurrence of an event justbefore the first period is counted is reproduced.

In Step S105, the reproduction controller 124 reproduces the eventrecording data stored in the recording unit 240 and the event recordingdata that has been reproduced is displayed on the display unit 260 bythe control performed by the display controller 126.

After the event recording data has been reproduced in Step S105, therecording controller 123 determines whether the reproduction of theevent recording data has been ended (Step S106). The determination inStep S106 is made when, for example, reproduction of all the eventrecording data, which is the target to be reproduced, has been completedor when the operation unit 250 has accepted a reproduction endoperation. When it is determined in Step S106 that the reproduction ofthe event recording data has been completed (Step S106: Yes), theprocess moves to Step S107.

After the reproduction of the event recording data, which is the targetto be reproduced, has been started in Step S105, the reproductioncontroller 124 may repeatedly reproduce the event recording data, whichis the target to be reproduced, until the operation unit 250 accepts thereproduction end operation.

When it is determined to be No in Step S101, it is determined to be Yesin Step S103, or it is determined to be Yes in Step S106, the recordingcontroller 123 determines, in the processing of Step S107, whether therecording of the first captured data has been ended. It is determined,in Step S107, that the recording has been ended when, for example, theengine, the power supply or the like of the vehicle, which is the movingbody, is turned off and the operation of the recording reproductionapparatus 10 is ended. Alternatively, the recording may be ended whenthe operation unit 250 accepts an instruction for ending the recordingreproduction processing.

According to the aforementioned processing, even when the user whodesires to check the circumstances of an event such as an accident byreproducing the event recording data does not know the functions of therecording reproduction apparatus 10 very well, it is possible to checkvideo images recorded as the event recording data easily and promptly.

As a modified example of the first embodiment, the face detection unit129 may determine, in Step S104, that a human face has been detectedwhen the human face that has come close to the display surface 261 ofthe display unit 260 is detected. When the recording reproductionapparatus 10 is a dashboard camera, the second camera 220 is installedin such a way that it is directed toward the driver and the passenger ofthe vehicle. Therefore, when it is desired to check the event recordingdata displayed on the display unit 260, the face is made close to therecording reproduction apparatus 10 or the recording reproductionapparatus 10 is removed from the vehicle and then the recordingreproduction apparatus 10 is made close to the face.

According to the aforementioned processing, it is possible to enable theuser who desires to check the circumstances of an event such as anaccident by reproducing the event recording data to check video imagesrecorded as the event recording data more appropriately.

The face detection unit 129 determines that the human face detected fromthe second captured data has come close to the display surface 261 ofthe display unit 260 when, for example, the human face detected from thesecond captured data has come close to the display surface 261 of thedisplay unit 260 so that the distance between the human face and thedisplay surface 261 becomes smaller than about 50 cm. The distance basedon which it is determined that the human face has come close to thedisplay surface 261 may be changed depending on the size of the displaysurface 261 of the display unit 260, i.e., the size of the displaypanel. Further, the distance based on which it is determined that thehuman face has come close to the display surface 261 may be such adistance at which it is possible to differentiate a person who is notgazing at the display surface 261 from a person who is gazing at thedisplay surface 261.

Further, the face detection unit 129 may determine that a human face hasbeen detected when the human face detected in Step S104 is oriented tothe front side or the substantially front side. Even when, for example,the face of the human who has come close to the display surface 261 ofthe display unit 260 has been detected, a case in which it is notintended to check the event recording data can be excluded. The facedetection unit 129 detects the contour of the face and the positions ofthe both eyes in the detected human face and determines, from thepositional relation thereof, whether the human face is oriented to thefront side or the substantially front side.

Referring next to FIG. 6, a second embodiment of the present disclosurewill be explained. Since many configurations and processes of therecording reproduction apparatus 10 according to the second embodimentare the same as those of the first embodiment, descriptions thereof willbe omitted.

FIG. 6 is a flowchart showing a process example according to the secondembodiment executed by the recording reproduction apparatus 10. Sinceprocessing of Step S101 and Step S111, Step S102 and Step S112, StepS103 and Step S113, Step S105 and Step S116, Step S106 and Step S117,and Step S107 and Step S118 is common in the processing shown in FIG. 5and the processing shown in FIG. 6, descriptions thereof will beomitted.

In Step S114, the face detection unit 129 detects a human face from thesecond captured data and specifies the eye in the detected human face,thereby acquiring the opening degree of the specified eye. The openingdegree of the eye detected here may be such a degree by which it can bedetermined, for example, whether the eye is closed or opened.

When the face detection unit 129 has detected the human face within thefirst period in Step S114 (Step S114: Yes), the face detection unit 129determines whether the opening degree of the eye in the detected face isequal to or larger than a predetermined degree (Step S115). Thedetermination made in Step S115 may be determination regarding whetherthe eye is closed or opened based on the opening degree of the eye.

When it is determined in Step S115 that the opening degree of the eye inthe detected face is equal to or larger than a predetermined degree orthe eye is opened (Step S115: Yes), the process moves to Step S116. Whenit is determined in Step S115 that the opening degree of the eye in thedetected face is smaller than the predetermined degree or the eye isclosed (Step S115: No), the process moves to Step S113. Even when it isdetermined to be No in Step S115, if the operation unit 250 has acceptedan instruction for starting reproduction, the reproduction of the eventrecording data is started.

According to the aforementioned processing, it is possible to enable theuser who desires to check the circumstances of an event such as anaccident by reproducing the event recording data to check video imagesrecorded as the event recording data more appropriately and to exclude acase in which it is not intended for the person of the detected face tocheck the event recording data.

Referring next to FIG. 7, a third embodiment of the present disclosurewill be explained. Since many configurations and processes of therecording reproduction apparatus 10 according to the third embodimentare the same as those of the first embodiment, descriptions thereof willbe omitted.

FIG. 7 is a flowchart showing a process example according to the thirdembodiment executed by the recording reproduction apparatus 10. Sincethe processing of Step S101 and Step S121, Step S102 and Step S122, StepS103 and Step S123, Step S105 and Step S126, Step S106 and Step S127,and Step S107 and Step S128 is common in the processing shown in FIG. 5and the processing shown in FIG. 7, descriptions thereof will beomitted.

When the face detection unit 129 has detected a human face within thefirst period in Step S124 (Step S124: Yes), the face detection unit 129determines whether the detected face is a human face registered inadvance (Step S125).

When it is determined in Step S125 that the detected face is a faceregistered in advance (Step S125: Yes), the process moves to Step S126.When it is determined in Step S125 that the detected face is not a faceregistered in advance (Step S125: No), the process moves to Step S123.When the operation unit 250 has accepted an instruction for startingreproduction even when it is determined to be No in Step S125,reproduction of the event recording data is started.

According to the aforementioned processing, when a person registered inadvance such as a driver of the vehicle on which the recordingreproduction apparatus 10 is mounted desires to check the circumstancesof an event such as an accident by reproducing the event recording data,this person can check video images recorded as the event recording datamore appropriately. When, for example, the vehicle on which therecording reproduction apparatus 10 is mounted involves in the accident,the event recording data can be definitely checked with the driver ofthe vehicle, who is the person involved in the accident. It is thuspossible to prevent the accident from being analyzed without includingthe person involved in the accident.

The third embodiment described with reference to FIG. 7 can be appliedalso to a case in which the face detection unit 129 has detected aplurality of human faces in Step S124. When, for example, the pluralityof human faces have been detected in Step S124, it is determined in StepS125 whether the plurality of human faces include the human faceregistered in advance. When it is determined in Step S125 that the humanface registered in advance is included (Step S125: Yes), the processmoves to Step S126. When the human face registered in advance is notincluded (Step S125: No), the process moves to Step S123.

According to the aforementioned processing, when a person registered inadvance such as a driver of the vehicle on which the recordingreproduction apparatus 10 is mounted desires to check the circumstancesof an event such as an accident by reproducing the event recording data,this person can check video images recorded as the event recording datamore appropriately. When, for example, the vehicle on which therecording reproduction apparatus 10 is mounted involves in the accident,the event recording data can be definitely checked with the driver ofthe vehicle, who is the person involved in the accident. It is thuspossible to prevent the accident from being analyzed without includingthe person involved in the accident.

Referring next to FIGS. 8 to 10, a fourth embodiment of the presentdisclosure will be explained. A recording reproduction apparatus 10according to the fourth embodiment is formed of a plurality ofapparatuses. FIG. 8 is a diagram conceptually showing a configuration ofthe recording reproduction apparatus according to the fourth embodimentof the present disclosure, and a recording reproduction apparatus 40 isformed of a vehicle-side apparatus 11 and a mobile terminal 50. Theconfiguration of the recording reproduction apparatus 40 is not limitedto that described in this embodiment as long as the recordingreproduction apparatus 40 is formed of a combination of apparatuseshaving similar functions.

In FIG. 8, the vehicle-side apparatus 11 is similar to the recordingreproduction apparatus 10 shown in FIGS. 2 and 3. When the vehicle-sideapparatus 11 is mounted above the windshield of the vehicle as thedashboard camera in such a way that it is directed toward the front sideof the vehicle, the first camera 410 in FIG. 2 is able to capture imagesof a front area, which is an outside of the vehicle, via the windshieldof the vehicle. The mobile terminal 50 includes a second camera 510 anda display surface 561 of a second display unit 560 arranged on the sameplane or on the substantially same plane in a housing of the mobileterminal 50 in such a way that the second camera 510 and the displaysurface 561 of the second display unit 560 are close to each other.

The vehicle-side apparatus 11 and the mobile terminal 50 are connectedby wireless communication. The vehicle-side apparatus 11 and the mobileterminal 50 are at least configured in such a way that the eventrecording data generated in the vehicle-side apparatus 11 is transmittedto the mobile terminal 50 using wireless communication. Therefore, inthe vehicle-side apparatus 11 and the mobile terminal 50, processing forestablishing communication such as pairing is performed in advance.

FIG. 9 is a block diagram showing a configuration of the vehicle-sideapparatus forming the recording reproduction apparatus according to thefourth embodiment of the present disclosure. The difference between thevehicle-side apparatus according to the fourth embodiment and thedashboard camera that functions as the recording reproduction apparatus10 shown in FIG. 1 is that the vehicle-side apparatus 11 needs notinclude the second camera and the face detection unit and thevehicle-side apparatus 11 includes a first communication controller 430and a first communication unit 490 that communicate with the mobileterminal 50. The other configurations in FIG. 9 are common to thoseshown in FIG. 1.

FIG. 10 is a block diagram showing a configuration of the mobileterminal that forms the recording reproduction apparatus according tothe fourth embodiment of the present disclosure. The mobile terminal 50includes the second camera 510, a face detection unit 529, and a secondcommunication controller 530 and a second communication unit 590 thatcommunicate with the vehicle-side apparatus 11.

In FIG. 10, the second camera 510 captures an area in the direction thatis opposed to the display surface 561 of the second display unit 560.The components shown in FIG. 10 are similar to those shown in FIG. 1.

A process example performed by the recording reproduction apparatus 40shown in FIGS. 8 to 10 will be explained using the example shown in FIG.5. In the processing performed by the recording reproduction apparatus40 based on FIG. 5, descriptions of the processing the same as thatdescribed in the first embodiment will be omitted. Further, theprocessing performed by the recording reproduction apparatus 40 is notlimited to being applied to the first embodiment and may be applied alsoto other embodiments. When the processing performed by the recordingreproduction apparatus 40 is started, the vehicle-side apparatus 11 andthe mobile terminal 50 are paired with each other and can performcommunication with each other.

When the event detection unit 427 of the vehicle-side apparatus 11 hasdetermined in Step S101 that an event has been detected (Step S101:Yes), the recording controller 423 transmits the first captured dataincluding the data at the event occurrence timing detected in Step S101to the mobile terminal 50 as the event recording data using the firstcommunication unit 490 as processing that corresponds to Step S102.Further, in the mobile terminal 50, the recording controller 523 storesthe event recording data received in the second communication unit 590in the recording unit 540.

When the event recording data is stored in the recording unit 540 of themobile terminal 50 in Step S102, the recording controller 523 determineswhether the first period has passed after the storage of the eventrecording data in Step S102 (Step S103).

When the recording controller 523 determines in Step S103 that the firstperiod has not passed (Step S103: No), the face detection unit 529 ofthe mobile terminal 50 determines whether the human face has beendetected from the second captured data captured by the second camera 510(Step S104). In other words, the face detection unit 529 detects a humanface from the second captured data captured by the second camera 510 forthe first period after the event recording data has been stored or afteran event has occurred.

When the second camera 512 is used in the aforementioned applications,the second camera 510 and the face detection unit 529 may not always beoperated. When, for example, the second communication unit 590 hasreceived the event recording data or when the recording controller 523has stored the event recording data, the second camera 510 may startcapturing images and the face detection unit 529 may start detecting aface.

When the face detection unit 529 has detected a human face within thefirst period in Step S104 (Step S104: Yes), the reproduction controller524 reproduces the event recording data that has been received from thevehicle-side apparatus 11 and stored in the recording unit 540 (StepS105). The event recording data reproduced by the reproductioncontroller 524 is displayed in the second display unit 560 of the mobileterminal 50. In other words, when the human face has been detected inthe front of the mobile terminal 50 within the first period (Step S104:Yes), the event recording data generated due to the occurrence of anevent just before the first period is counted is reproduced in themobile terminal 50.

According to the aforementioned processing, even when the user who wantsto check the circumstances of an event such as an accident by performingreproduction of the event recording data does not know the functions ofthe recording reproduction apparatus 10 very well, this user can checkvideo images recorded as the event recording data easily and promptlyusing, for example, another apparatus such as the mobile terminal 50.

Note that the present disclosure is not limited to the above-describedembodiments and may be changed as appropriate without departing from thescope of the present disclosure. For example, while the first period hasbeen described as, for example, a fixed value such as ten minutes in theprocessing of Step S103 etc., the first period may be a period thatvaries depending on conditions. Further, it is possible that the driverand the passenger whose faces are registered in advance may not be ableto participate in the investigation of an accident depending on themagnitude of the accident. In this case, reproduction of the eventrecording data can be performed by normal operations.

Further, the program(s) for causing a computer to execute theaforementioned processing can be stored using any type of non-transitorycomputer readable media and provided to the computer operating as arecording reproduction apparatus.

The present disclosure is available as a recording reproductionapparatus for recording and reproducing captured data captured in avehicle.

What is claimed is:
 1. A recording reproduction apparatus comprising: acaptured data acquisition unit configured to acquire first captured datacaptured by a first camera that captures an image of an outside of amoving body and second captured data captured by a second camera thatcaptures an image in a direction that is opposed to a display surface ofa display unit; an event detection unit configured to detect an event onthe moving body; a recording controller configured to store, when theevent detection unit has detected an event, the first captured dataincluding at least data at a timing when the event has occurred as eventrecording data; a face detection unit configured to detect a human facefrom the second captured data; a reproduction controller configured toreproduce the event recording data when the face detection unit hasdetected a human face within a predetermined period after the storage ofthe event recording data; and a display controller configured to causethe display unit to display the event recording data reproduced by thereproduction controller.
 2. The recording reproduction apparatusaccording to claim 1, wherein the face detection unit detects whetherthe detected human face has come close to the display surface of thedisplay unit, and the reproduction controller reproduces the eventrecording data when the face detection unit has determined that a humanface has come close to the display surface of the display unit within apredetermined period after the storage of the event recording data. 3.The recording reproduction apparatus according to claim 1, wherein theface detection unit further detects an opening degree of an eye in thedetected human face, and the reproduction controller reproduces theevent recording data when the face detection unit has detected a facewhose opening degree of the eye is equal to or larger than apredetermined degree within a predetermined period after the storage ofthe event recording data.
 4. The recording reproduction apparatusaccording to claim 1, wherein the face detection unit further detects aline of sight in the detected human face, and the reproductioncontroller reproduces the event recording data when it is detected thatthe line of sight has been directed to the display surface of thedisplay unit within a predetermined period after the storage of theevent recording data.
 5. The recording reproduction apparatus accordingto claim 1, wherein the face detection unit detects a human faceregistered in advance, and the reproduction controller reproduces theevent recording data when the face detection unit has detected a humanface registered in advance within a predetermined period after thestorage of the event recording data.
 6. The recording reproductionapparatus according to claim 5, wherein the reproduction controllerreproduces the event recording data when the face detection unit hasdetected a plurality of faces including a human face registered inadvance within a predetermined period after the storage of the eventrecording data.
 7. The recording reproduction apparatus according toclaim 1, wherein the captured data acquisition unit acquires the secondcaptured data captured by the second camera when the event detectionunit has detected an event.
 8. A recording reproduction methodcomprising: a first captured data acquisition step for acquiring firstcaptured data captured by a first camera that captures an image of anoutside of a moving body; an event detection step for detecting an eventon the moving body; a recording step for storing, when an event has beendetected, the first captured data including at least data at a timingwhen the event has occurred as event recording data; a second captureddata acquisition step for acquiring second captured data captured by asecond camera that captures an image in a direction that is opposed to adisplay surface of a display unit; a face detection step for detecting ahuman face from the second captured data; a reproduction step forreproducing the event recording data when the human face has beendetected within a predetermined period after the storage of the eventrecording data in the recording step; and a display step for causing thedisplay unit to display the event recording data reproduced in thereproduction step.
 9. A non-transitory computer readable medium storinga program for causing a computer operating as a recording reproductionapparatus to execute the following steps: a first captured dataacquisition step for acquiring first captured data captured by a firstcamera that captures an image of an outside of a moving body; an eventdetection step for detecting an event on the moving body; a recordingstep for storing, when an event has been detected, the first captureddata including at least data at a timing when the event has occurred asevent recording data; a second captured data acquisition step foracquiring second captured data captured by a second camera that capturesan image in a direction that is opposed to a display surface of adisplay unit; a face detection step for detecting a human face from thesecond captured data; a reproduction step for reproducing the eventrecording data when the human face has been detected within apredetermined period after the storage of the event recording data inthe recording step; and a display step for causing the display unit todisplay the event recording data reproduced in the reproduction step.